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A filiANlMGfUL 
EVALUATION OF FOREIGN 
LANGUAGE LEARNING: 
^READING AND WRITING 

by Jacqueline Benevento, District 
Coordinator of Foreign Lan- 
guages, Collingswood, N.J. Pub- 
lic schools 

(Adapted from panel presenta- 
tion, NJFLTA meeting, College 
of St. Elizabeth, March 16, 
1988.) 

It seems fitting for me, as the 
last speaker on this panel, to 
pause and ask you to.recpnsid_ex_. 

me the title of our topic: “A 
Meaningful Evaluation of Foreign 
Language Learning." 

Let us at this point make a 
distinction between the terms 
measurement and evaluation. 
Suppose there are 50 items in a 
multiple -choice readingcompre- 
hension test. A certain pupil 
gets 45 items correct — we as- 
sign a number to his achievement 
and say that he has a score of , 
45. We have measured hi^ 
achievement in this particular 

■ test. At the end of the marking 

period, we consider his several 
test scores, and we add to these 
measurements our judgment 
about the quality of his partici- 

tion in classroom and language 
aboratory, his homework, and 
so forth; that is, judgments in\ 
all those areas which we describe 
in words but do not assign num- 
bers to. Measurement is a part 
of evaluation. Measurement may ■ 
be thought of as a quantitative 
process, and evaluation a quali- 
tative one. 

We know that a test is more 
reliable when it is objectively 
scored. Our evaluation of the 
pupil's performance at the end 
of the marking period will be 
more reliable as it is more ob- 
jective. As reliability increases, 
so will meaningfulness. Thus, a 
meaningful evaluation is one 
•which contains, among other 
things, reliable quantitative mea- 
surements of his achievement, 
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We also know that a test js 
valid when it tests what has been 
taught. Meaningful test-making is 
closely intertwined with the 
teaching process. It is suggested 
that a "table of specifications" 
be kept as a unit is planned and • 
taught, thus ensuring more valid 
tests. • 

For a test to be meaninful to 
the pupil, it must give hina a 
chance to demonstrate what 'he 
has learned, and it should be re- 
turned to him as soon as possible, 
while interest is still high, so 
that it may properly be’a part of 
the learning process. 

We also know that our teaching 
should be guided by what we want 
the pupil to learn; that is how we 
want his behavior to be changed 
by the time he finishes the course, 
or the unit, or the class period. 

The problem has been, it seems 
to me, how to state our long- 
range objectives in a common 
frame of reference, and how to 
determine where our objectives 
. for the foreign language learner 
fit into general educational objec- 
tives. After we define our long- 
range objectives, we must then 
define our short-range objectives 
in specific terms. 

To recapitulate before contin- 
uing: For evaluation to be mean- 
ingful, we must do three things, 
all inter-related: 1) define our 
-objectives, both long-range and 
short-range, clearly and in terms 
of pupil behavior; 2) teach to 
_raeet. lh.ese_ objectives; and 3) 
test to determine pupil achieve- 
ment of these objectives. 

It is at this point that the Tax- 
onomy of Educational Objectives, 
Cognitive Domain comes into fo- 
cus. The Taxonomy, published in 
1956, is the result of work begun 
in 1948 to classify educational 
goals in a common frame of ref- 
erence for greater precision, and 
to provide a convenient system 
for categorizing test items. The 
principle of complexity is the or- 
dering basis for educational ob- 
jectives in the cognitive domain. 
These objectives are: Knowl- 
edge, Comprehension, Applica- 
tion, Analysis, Synthesis and ' 



Evaluation. You will note the 
hierarchical arrangement, with 
each higher level subsuming 
those below it. I have obtained 
permission of the publisher to 
reproduce the Condensed Ver- 
sion of the Taxonomy w hich de- 
fines and explains these cate- 
gories more fully, end I urge 
you to pick up a copy as you 

leave today. This Condensed Ver- 
sion does not contain the test ex- 
amples for each category as the 
Handbook does. 

When we thinx auuut reading 
and writing in our native tongue, 
we usually think of entering into 
the higher levels of the cogm- 

tive processes, beyond the knowl- 
edge of facts and terminology. 
What I am inviting you to do to- 
day is to explore with me the 
cognitive processes which we can 
reasonably expect of the foreign 
language learner at various 
stages of learning the reading 
and writing skills, to decide in 
which cognitive areas you wish to 
measure his achievement and to 
write tests accordingly. (A se- 
lected bibliography on educa- 
tional measurement and evalua- 
tion in general, and on foreign 
language testing in particular, 
is to be found at the end of this 
article.) My purpose is to stim- 
ulate your thinking about testing 
■ from a different perspective. As 
you will quickly se'e the terrain . 
is chartered, and I can only 
ask you to share with me my 
throughts and questions as we 

pxolore together. 

The Taxonomy, then, can help 

us direct our pupils beyond ac- 
quisition of facts and terminol 
to "tho higher-ievei Intellec- 
tual skills. It should be empha- 
sized here that knowledge is not 
unimportant. As weh have seen, 
it is the first step in the hier- 
archy. . .obviously, one cannot 
comprehend what he doesn't 
know; or apply, analyze, synthe- 
size or evaluate what he doesn't 
comprehend. We also know that 
we cannot expect pupils to learn 
what they haven't been given an 
opportunity to practice. (Paren- 
' thetically, pupils also seem to 
study what toey expect to be 
tested on.) 



Let us now consider the two 
major Kinds of tests: objective- 
tjrpe tests and essay tests, and 
their advantages and disadvan- 
tages, because testing will be a 
matter of deciding what it is we 
want to measure, and then 
choosing the kind of test to ac- 
complish this purpose. 

Objective tests include the fol- 
lowing kinds of items: recogni- 

•tion items for reading tests, 
such as true-false, matching and 
multiple - choice; and recall 
short-answer completion items 
for writing tests. Advantages of 
objective tests includes: 1) great- 
er smapling (a much more ex- 
tensive area can be tested in a 
shorter period of time than can 
be tested with an essay test); 

2) greater scorer reliability (on- 
ly one answer is accepted no 

, matter who does the scoring); 

3) greater ease of scoring. 

As for essay (composition) 
tests, they are less reliable to 
score, but certain procedures 
can be used to improve relia- 
bility. Although a good essay test 
cannot be quickly prepared, it 
does take less time to prepare 
than an objective-type test. The 
greatest advantage of an essay 
test is that it clearly provides 
the opportunity to test the pupil’s 
writing in the light of how he 
chooses, organizes and presents 
information. 

The kind of test chosen will be 
clearly affected by the level of 
learning to be tested. In the 
Knowledge category (as defined 
in the Taxonomy), objective tests 
are more efficient. Some pub- 
lishers make such tests avail- 
able to users of their textbooks. 
Several examples of the objec- 
tive-type items are given in 
Making Your Own Language Tests 
by Dr. Nelson Brooks, which is 
available for you as you leave to- 
day. Numerous test items are al- 
so illustrated in the Lado and Val- 
ette books in the bibliography. 
These items v-nich measure con- 
trol of reading and writing in the 
earlier stages of learning, where 
the emphasis is necessarily on 
the Knowledge area, properly 
deal with structure and vocabul- 
ary. 

There is no doubt that objec- 
tive-type test items are easier 
to write for the Knowledge cat- 
egory. However, if we wish to 
test pupil achievement in • the 
higher congnitive levels, we must 
learn how to write test items to 
measure it. Why do we not often 
see reading tests prepared for 
measuring beyond the compre- 
hension level? Why not writing 
tests appropriate to the three 
highest levels of the cognitive . 
domain? Does measurement of 
the higher levels of analysis, 
synthesis and evaluation lie out- 
side the realm of foreign lang- 



uage teaching? Just how crea- 
tive can we expect the learner 
*to be in a foreign tongue? . | 

Tests lor the intellectual skills ‘ 
must involve knowledge and skills 
which the pupil has previously 
learned, but the problem itself 
must ‘,e new to him. Thus, in the 
earlier stages, reading material 
for comprehension should be in 
the form of re-combination nar- 
ratives, for example. Lado lists 
multiple-choice items for read- 
ing comprehension at the inter- 
mediate level dealing with in- 
terpretation and with the testing , 
of sequence signals. “Pure” 
reading tests for the Compre- 
hension and Application levels 
for more advanced students, so 
as not to involve writing, can also 
best be tested by skillfully con- 
structed multiple-choice items. 
Since tests of this type are j 
rather difficult to compose, the * 
teacher may wish to use exam- 
inations available in some re- 
view workbooks. 

Since writing involves reading, , 
it is higher in complexity than i 
comprehension. To test writing i 
in the earlier stages is to test ■, 
the knowledge of spelling and 
punctu iOn. Completion items 
may be used, but the difficulty 
is in finding items for which 
'only one answ r would be cor- 
rect. A relatively easy writing 
test at the Application level is a 
dictation which the pupil has not 
yet studied in that form. . .per- 
haps a resum^ of a selection as- 
signed for extensive reading. 
What he has learned about spell- 
ing and punctuation would have 
to be applied. Dictations of this 
type should not be mistaken fpr 
“creative” writing. . .the voca- 
bulary and syntax are supplied 
by the teacher. One-sentence an- 
swers to questions referring to •' 
passages supplied for reading 
comprehension could also be 
used. The questions would have 
to be very carefully constructed, 
and the passages not previously 
studied, so that memory, which 
would fall into the Knowledge 
category, would not be tested. 

For more advanced pupils, an- 
other technique at the Applica- 
tion level is to ask for a brief 
paragraph about each of two or 
three pictures. Only mechanics 
would be graded. At an even i 
more . advanced level, Uie pupil ^ 
would be asked to write two ^ 
short compositions about two pic- 
tures, with a time limit of .about 
30 minutes each. Content would 
be graded as wejl as mechanics, 
with two separate grades. Re- 
garding content, the teacher can 
make a checklist of the points of 
information which should be in- 
cluded, their logical arrange- 
ment, and the sequence signals 
expected to be used. The teacher 



may also a.sk the pupil to write, 
in a controlled manner, a letter 
to a friend in France, a descrip- 
tion of his house, an account of 
his vacation, etc. 

Higher lever skills in writing 
requiring the pupil to analyze, 
synthesize and evaluate seem 
to be best tested by the true 
essay-type questions; that is, we 
ask him to express his thoughts 
in writing. While it is quite true 
that we can’t expect the pupil to 
learn how to write unless we ask 
him to write, it is also true that 
the essay teat demands a rather 
sophisticated control of the lang- 
uage. Let us now consider the 
higher levels in the cognitive do- 
main, and some illuatrativ'e es- 
say test items. 

Analysis is important i^i ad- 
vanced foreign )pn-''nn'p study 
when the sjudent is expected not 
only to comprehend a work of 
literature, but also to appreciate 
its beauty through a study of its 
structure. As a beginning writing 
test in this area, the pupil may 
first be asked to write a resume 
of a selection, or to outline a 
story. At an even more advanced 
level, we might ask him to de- 
termine the point of view of an 
author, or to write an “explica- 
tion detexte” of a poem not pre- 
viously studied in class. 

Synthesis is the intellectual 
skill which is often called “ere-, 
ativity.” The learner mus’ cre-_ 
ate something new. We may ask’ 
him to complete an unfinished 
story or poem, to relate the most^ 
amusing or saddest thing that' 
ever happened to him, and, much^ 
later, to write an original poem 
or short story. I 

The ability to evaluate involve sj 

all the behaviui a vvhiuh preueUe it ^ 

in the Taxonomy. The learner ^ 
must have knowledge of the cri-|, 
teria for evaluation, he must^ 
comprehend what he is to eval- 
uate, he must apply the tech-j 
niques of evaluation, he must be j 
able to analyze what he is to^ * 
evaluate, and he must be able to • 
synthesize all these elements so ^ 
as to write an original commun- 
ication. To ask him to write a 
crituque of a play or film would 
fit into thi.s category. 

Composing good essay test 
items is quite demanding. Some 
principles to be observed are: 

1) do not test for specific infor- 
mation; 2) make clear the scope 
of the response; 2) allow the pu- / 
pil enough time to select, organ- ■ 
ize and write; 4) have all pupils ' * 
answer the same questions. Scor- *•' 
ing essay tests is also demand- 
ing. It a subjective process, 
but there are a few suggestions 
to make it more reliable: 1) ^ 
make a list of the important ^ 
points which you think should be ^ 
mentioned; 2) do not look at the , 



pupil’s name before you mark uis ^ 

test; 3) score all responses to one ^ 

item befr e going on to the next ^ 
one, if -tere is more than one 
question; 4' inform pupils about, 
the method of scoring in advance; ^ 

they should know if errors in ^ 
igpGlung aadi punctuation will al » 

feet their marks, or if separate 
marks are to be given for con- 
tent and mechanics. My own bias 
is that if there are too many er- 
rors in mechanics, the wrong 
testing instrument ‘‘as been se- 
lected. 

The prpblem seems to be to 
determing just where in the 
learning sequence the pupil can 
move out of the Knowledge cat- 
egory into the higher level pro- 
cesses. It seems to me that test- 
ing reading and writing beyond 
this point has remained a rather 
vague area for most of us. Just 
when will the foreign language 
learner be able to read and write 
meaningful material without be- 
ing hampered by mechanics? It 
is clear that we cannot expect 
the fourth year high school pupil 
to write a good resume of a story 
or to write an interesting letter 
unless we have carefully taken 
him through succeeding steps in 
his foreign language learning so 
that he can arrive at this skill. 
Since less than ten percent of 
those pupils who begin foreign 
language continue into the fourth 
year, small wonder that the area 
of the essay test has not been 
clearly delineated, and that those 
relatively few foreign language 
teachers who do teach fourth 
classed 

guidelines for testing. What I 
hope to do here is to offer you 
some of the tools, so that togeth- 
er we may develop these guide- ^ 
lines most applicable in our in- i 
dividual situations. I 
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